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Background: Upper respiratory infections, acute sinus infections, and sore throats are common symptoms 
that cause patients to seek medical care. Despite well-established treatment guidelines, studies indicate that 
antibiotics are prescribed far more frequently than appropriate, raising a multitude of clinical issues. 
Methods: The primary goal of this study was to increase guideline adherence rates for acute sinusitis, 
pharyngitis, and upper respiratory tract infections (URIs). This study was the first Plan-Do-Study-Act (PDSA) 
cycle in a quality improvement program at an internal medicine resident faculty practice at a university-affiliated 
community hospital internal medicine residency program. To improve guideline adherence for respiratory 
infections, a package of small-scale interventions was implemented aimed at improving patient and provider 
education regarding viral and bacterial infections and the necessity for antibiotics. The data from this study was 
compared with a previously published study in this practice, which evaluated the adherence rates for the 
treatment guidelines before the changes, to determine effectiveness of the modifications. After the first PDSA 
cycle, providers were surveyed to determine barriers to adherence to antibiotic prescribing guidelines. 
Results: After the interventions, antibiotic guideline adherence for URI improved from a rate of 79.28 to 
88.58% with a p-value of 0.004. The increase of adherence rates for sinusitis and pharyngitis were 41.7- 
57.58% (p =0.086) and 24.0-25.0% (p =0.918), respectively. The overall change in guideline adherence for the 
three conditions increased from 57.2 to 78.6% with the implementations (p < 0.001). In planning for future 
PDSA cycles, a fishbone diagram was constructed in order to identify all perceived facets of the problem of 
non-adherence to the treatment guidelines for URIs, sinusitis, and pharyngitis. From the fishbone diagram 
and the provider survey, several potential directions for future work are discussed. 

Conclusions: Passive interventions can result in small changes in antibiotic guideline adherence, but further 
PDSA cycles using more active methodologies are needed. 
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The diagnoses of upper respiratory tract infections 
(URI), acute sinus infections, and pharyngitis 
are common conditions that cause patients to 
seek medical care. Every year approximately 25 million 
people visit their primary care physician with uncom- 
plicated URIs and approximately l-2"/o of all hospital 
visits involve individuals presenting with a complaint of 
sore throat (1-4). Despite well-established treatment 
guidelines (Table 1), studies indicate that URIs and 
bronchitis account for 75% of unnecessary antibiotics 
prescribed in the hospital setting (5). In addition, a 
national survey revealed that 73% of adults with phar- 
yngitis in the United States received antibiotics, a much 



higher percentage than would be indicated by applica- 
tion of the present guidelines (6-9). 

Given the high volume of respiratory cases seen in 
the ambulatory and emergency department settings, 
over-prescription of antibiotics for these illnesses raises 
the specter of bacterial drug-resistance (10). This rise of 
resistance can lead to an increase in the morbidity and 
mortality risks for patients in the community, as well 
as potentially increasing the costs of treating infectious 
diseases (11). In response, various organizations are 
analyzing methods to decrease the unnecessary use of 
antibiotics. The Centers for Disease Control and Pre- 
vention (CDC) has launched a national campaign to 
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Table 1. Antibiotic prescribing guidelines 



Diagnosis 



Guidelines 



Pharyngitis 

Upper respiratory tract 

infection 
Sinusitis 



Bisno, et al. Clinic Infect Dis 2002 
Wong et al. Am Fam Physician 2006 

Rosenfeld, et al. Otolaryngol Head 
Neck Surg 2007 



promote appropriate antimicrobial drug use aimed at 
educating clinicians and the public, and developing 
and implementing interventions to promote changes in 
prescribing practice (12). 

In a previously published study evaluating the effect of 
the presence of a learner on guideline adherence, overall 
guideline adherence was found to be poor, particularly for 
pharyngitis. The primary goal of this study was therefore 
to increase treatment guideline adherence rates for acute 
sinusitis, pharyngitis, and URI through a quality im- 
provement initiative (13). 

Methods and analysis 

This program was the first Plan-Do-Study-Act (PDSA) 
cycle in a quality improvement program at an internal 
medicine resident faculty practice at a university-affiliated 
community hospital internal medicine residency pro- 
gram. On October 1, 2012, the practice introduced three 
simultaneous interventions to increase treatment guide- 
line adherence for these respiratory infections. First, the 



guidelines were sent via email to all providers of the 
medical practice, including the six attending physicians, 
23 residents, and one nurse practitioner (14-16). In the 
second intervention, CDC educational posters depict- 
ing the appropriate treatment of viral URIs were placed 
in examination rooms (http://www.cdc.gov/getsmart/ 
campaign-materials/posters.html). These were provided 
in English and Spanish, the two principal languages 
spoken by the practice patient population. For the third 
intervention, providers were educated about the CDC 
Get Smart: Know When Antibiotics Work prescription 
pads (www.cdc.gov/getsmart/campaign-materials/print- 
materials/ViralRxPad.html). These were made available 
in examination rooms and in the preceptor conference 
room. 

From October 1, 2012, to February 4, 2013, visits were 
identified using Centricity (GE Healthcare, London, 
England) electronic medical records by searching ICD-9 
codes for diagnosis of URI (ICD-9 code 465.9), sinusitis 
(ICD-9 codes 461.8, 461.9, 473.9), and sore throat/ 
pharyngitis (ICD-9 codes 034.0, 462.0). On February 4, 
the practice switched to the Epic electronic health record 
system (Epic Systems Corporation, Verona, Wisconsin). 
Under this system, patients were identified by search- 
ing acute patient encounters for visit diagnoses of URI, 
sinusitis, or pharyngitis. 

A total of 388 visits were identified from October 1, 
2012, through June 28, 2013. In 280 visits, the encounter 
met the inclusion criteria. The remaining 108 visits met 
one of the following exclusion criteria: chronic sinusitis, 



388 Total Patient Encounters 



280 Included 



219 URI 



33 sinusitis 



28 pharyngitis 



108 Excluded 



29 incorrectly coded 
diagnoses 



27 repeat visit for same 
diagnosis 



21 prescribed 
antibiotics prior to visit 



17 chronic sinusitis 



10 with other conditions 
justifying antibiotics 



4 immunocompromised 



Fig. 1. Patient population. 
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incorrectly coded diagnoses, immunocompromised state, 
other concurrent medical conditions justifying anti- 
biotic prescription, repeat visits for the same diagnosis, 
and receipt of antibiotics prior to the visit (Fig. 1). 
A trained research associate performed a chart review 
to determine guideline adherence. The research associate 
and one physician author reviewed the first 10% of all 
cases simultaneously, and thereafter every 10th case was 
independently reviewed by the physician author to reduce 
inter-rater variability. Agreement between reviewers was 
100%. 

The data were pooled by year and compliance and 
analysis was performed by Chi-square test of association 

Table 2. Survey results for practicing members 



How many years has it been since you graduated from medical school? 



Years 


Total 


Percentage 




0-5 


23 


76.67 




6-10 


3 


10 




11-15 


1 


3.33 




More than 1 5 years 


3 


10 




For the diagnoses of pharyngitis, URI, and sinusitis, how well do you know believe that you know the treatment guidelines? 




Total 


Percentage 




Not at all 


0 


0 




Mildly well 


10 


33.33 




Moderately well 


16 


53.33 




Very well 


4 


13.33 




For the diagnoses of pharyngitis, URI, and sinusitis, how often do you believe you prescribe antibiotics in a guideline adherent manner? 




Total 


Percentage 




0-25% of the time 


6 


20.0 




26-50% of the time 


8 


26.67 




51-75% of the time 


10 


33.33 




76-100% of the time 


6 


20.0 




For each of the following factors that might influence your decision to prescribe antibiotics, please indicate the importance of each factor: 






Total 


Percentage 


Patient desires antibiotics 


Not at all important 


12 


40.00 




Mildly important 


14 


46.67 




Moderately important 


3 


10.0 




Very important 


1 


3.33 


Uncertainty in diagnosis 


Not at all important 


2 


6.67 




Mildly important 


13 


43.33 




Moderately important 


14 


46.67 




Very important 


1 


3.33 


Lack of knowledge guidelines 


Not at all important 


5 


16.67 




Mildly important 


11 


36.67 




Moderately important 


10 


33.33 




Very important 


4 


13.33 


Lack of clinical decision support tools 


Not at all important 


6 


20.0 




Mildly important 


16 


53.33 




Moderately important 


7 


23.33 




Very important 


1 


3.33 



using SPSS software (International Business Machines, 
Armonk, New York). Significance was determined by 
p-values less than 0.05. 

At a required conference at the conclusion of the 
interventions, an anonymous survey was distributed to all 
of the providers which explored familiarity with and 
barriers to guideline adherence. The survey was collected 
by a non-participant clerical staff member. Response rate 
was 88% (Table 2). 

Results 

The change of adherence rates can be found in Table 3. 
After the interventions, guideline adherence for URI 
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Table 3. Guideline adherence rates 



GuidGNnG 




ZUUo— ziU \ tL y\tL) 


oc\^ T 

eL\J \ O 


P 


Sinusitis 


No 


130 


14 


0.086 




Yes 


93 


19 






Total 


223 


33 






Compliance % 


41.70 


57.58 




PInaryngitis 


No 


104 


21 


0.918 




Yes 


33 


7 






Total 


147 


28 






Compliance % 


24.09 


25.00 




URI 


No 


75 


25 


0.004 




Yes 


287 


194 






Total 


362 


219 






Compliance % 


79.28 


88.58 




Total cases 


No 


309 


60 


<0.001 




Yes 


413 


220 






Total 


722 


280 






Compliance % 


57.2 


78.6 





improved from 79.28 to 88.58% (p =0.004). The increase 
of adherence rates for sinusitis and pharyngitis were 
41.7-57.58% (p =0.086) and 24.0-25.0% (p =0.918), 
respectively, but both were not statistically significant. 
The overall guideline adherence rate for the three 
conditions increased from 57.2 to 78.6% (p < 0.001). 

The results of the survey can be found in Table 2. Most 
providers completed medical school in the preceding five 
years. The majority (86%) of respondents beUeved that 
they did not know the treatment guidelines 'very well', 
and 83% believed a 'lack of knowledge of the guidehnes' 
contributed to their decision to prescribe antibiotics. 
Only 20% of respondents believed they prescribed anti- 
biotics according to the guidelines more than 75% of the 
time and 80% indicated that the lack of clinical decision 
support tools might have been a factor influencing a 
decision to prescribe antibiotics. 

Discussion 

The addition of these simultaneous passive, small-scale 
interventions resulted in a significant increase in guide- 
line adherence rate for the treatment of URIs and trended 
toward significance for sinusitis. However, pharyngitis 
guideline adherence did not improve. Previous studies 
within the practice have indicated that patient age and 
comorbidities, day of the week, month of the year, and 
fear of a callback or second visit for the same issue were 
not determinants of guideline adherence (13). From the 
provider survey, lack of knowledge of the guidelines and 
guideline complexity were identified to be major con- 
tributors to non-adherence. 

Appropriate antibiotic treatment for Streptococcal 
pharyngitis is determined by the Modified Centor score. 



which incorporates criteria of fever, tonsillar exudates or 
swelling, absence of cough, presence of lymphadenopa- 
thy, and age (17). Applying the score to the clinical 
decision making of experienced clinicians improves the 
sensitivity and specificity of diagnosis to 64-83'/o and 
67-91%, respectively (17). Additionally, its use has been 
estimated to reduce inappropriate antibiotic treatment 
by as much as 88% (18). A score greater than 4 requires 
antibiotics, while a score of 2-3 calls for throat culture or 
rapid Streptococcal antigen test. Rigorous application 
can be challenging in real time clinical situations. In one 
center where rapid antigen testing was routinely per- 
formed and backup culture or DNA probe was immedi- 
ately available, the rates of antibiotic prescribing, even 
with multiple negative tests, was still unacceptably high, 
with 56% of patients presenting with pharyngitis receiv- 
ing antibiotics and only 18% of patients having confirmed 
Streptococcal pharyngitis (19). 

In contrast to previous studies, this practice's non- 
adherence to pharyngitis treatment guidelines resulted 
not only from the expected unnecessary antibiotic pre- 
scriptions, but also unwarranted throat cultures. Em- 
bedded within the guidelines produced by the American 
College of Physicians and the CDC on the principles of 
appropriate antibiotic usage for acute pharyngitis is the 
necessary requirement to clinically screen all patients 
with the Centor criteria and only order a throat culture 
when warranted by this screening process (14). Therefore, 
ordering a throat culture when not indicated by this score 
is a violation of the treatment guidelines. In 57%o of the 
non-adherent visits, unnecessary cultures were the only 
violation of the guidelines. In this facility, the cost of 
a Streptococcal culture is $51.75. If the test is positive, 
there is a further charge of $22.25 for organism identi- 
fication. All of the cultures performed in a non-guideline 
adherent manner were negative, resulting in a $621.00 
increase in cost in this small study. If this non-adherence 
mirrors other practices, this would result in a significant 
unnecessary cost to the health care system. 

The survey results also suggest that adherence to 
complex diagnostic algorithms might be improved by 
the application of a different didactic process for future 
PDSA cycles. The bulk of respondents were residents 
who are learning about these illnesses. The majority 
believed they did not know the treatment guidelines 
very well although they had been distributed widely. 
The majority recognized this contributed to their decision 
to prescribe antibiotics inappropriately, and acknowl- 
edged that the lack of clinical decision support tools 
might have been a factor influencing a decision to pre- 
scribe antibiotics. This is particularly important because 
electronic clinical decision support tools theoretically 
inform and educate patients and providers on the correct 
plan of care, and limit external pressure to prescribe 
antibiotics. In the provider survey, 50% responded that 
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BeUef that 
antibiotics heal 
viral infections 




Language Barrier 



Physician Factors 



Lack of decision 
support in EMR 



Change of computer 
system/ongoing preload 



Knowledge of viral vs 
bacterial infections 



Physician fear of 
litigation 



Knowledge of 
guidelines 



Non-adherence 



Incorrect 
documentation of 
current ilhiess 
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Educational posters 
in Spanish not in 



Rapid strep test not 
available in office 



Complexity of published 
guidelines 



Environment/organization Materials/Resources 



Communication 



Fig. 2. Fishbone diagram for non-adherence with guidelines. 

a patient's desire for antibiotics would have some 
influence on their decision to prescribe them, indicating 
strong social pressure to prescribe antibiotics. 

In planning for a second PDSA cycle, a fishbone 
diagram was constructed to identify all facets of the 
problem (Fig. 2). As was learned from the survey, context 
specificity of an intervention is important to the future 
success. For example, in a region where patient expec- 
tation is the driver for antibiotic prescribing, an interven- 
tion of a clinical decision support tool aimed at calculat- 
ing scores to educate providers about guidelines would 
be less effective than a community outreach to change 
the antibiotic-requesting culture of the community (20). 
From the fishbone diagram and the provider survey, 
it appears that technological solutions may be helpful 
in improving our adherence rates. The Modified Centor 
score is complicated and requires calculation, and a 
clinical decision support tool designed to assist providers 
unfamiliar with the guideline may help to increase ad- 
herence rates. However, the incorporation of clinical 
decision support tools into electronic health records has 
had disappointing results overall, and, in this particular 
venue, has been shown to reduce broad spectrum anti- 
biotic usage to more narrow spectrum antibiotics, but did 
not reduce the rate at which antibiotics were inappropri- 
ately prescribed in the first place (21). The educational 
intervention for the providers in the practice was a passive 
distribution of the guidelines. Future PDSA cycles will 
include more active methodology, such as: incorporation 
of relevant cases into the ambulatory morning report 
series; inclusion of this project into the formal residency 
program quality improvement series; provider report 



cards; and consideration of a peer academic detailing 
program, which was recently shown effective in improving 
antibiotic prescribing in acute respiratory tract infections 
(22). 

This study had several limitations. First, the providers 
were not educated in advance regarding appropriate 
diagnosis codes, resulting in different coding of the same 
illness, for example, coding cough rather than URL Due 
to wall space limitations, either an English or a Spanish 
poster was placed in the patient rooms, rather than both, 
which could have limited its educational potential. As this 
was a quality improvement initiative pertaining to office 
visits only, there are no data on prescribing patterns with 
telephone calls. Finally, this study was performed in a 
single primary care practice; therefore, the generalizability 
of the findings may be limited. 
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